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ABSTRACT 


Various architectures and their respective softuare for Hierarchically 
Intelligent Robots are discussed In this paper. They confore to the Principle of 
Increasing Precision ulth Decreasing Intelligence by folloulng a three-level 
structure. The architecture of the organization and coordination levels Is 
presented here and their algorithms are outlined. 


2. INTRCDUCTIGM 

Intelligent Robots are a special type of Intelligent Machines C5I. They nay be driven by controls ulth 
special characteristics described by the nethods of Hierarchically Intelligent Control Systems [31. 

Hierarchically Intelligent Control Is based on the Principle of Incre asing intelligence ulth Decreasing 
Precision . Intelligent Robots (and thus Intelligent Machines) nay be modeled based on the constraints Imposed 
by the Theory of Intelligent Controls. They are considered to be composed of three Interactive levels, or- 
ganization. coordination and execution. They utilize feedback mechanisms from the hardware processes of the 
execution level to the organizer selectively, by aggregation of the Information at every level (Figure 1). 

A three Interactive level probabilistic model has already been defined [4.5] for Intelligent Robots. The 
organization level Is modeled after a Knowledge Based System; It performs general knowledge processing tasks 
with little or no precision. The coordination level Is composed of a specific number of coordinators, each 
performing Its own pre-spec! find functions; It performs specific knowledge processing tasks. The execution 
level Is composed of specific execution devices (hardware) associated with each coordinator. The probabilistic 
model Is obtained by defining the various operations associated with each level of Intelligent Robots In a 
mathematical way and then assigning a probabilistic structure to organize the appropriate tasks for execution. 

A simple but complete architectural model that can accommodate fast and reliable operation for the levels 
Individual functions has also been derived [5]. Each level has a functional task to perform. The functional 
task of each level Is performed In the best possible way based on accumulated Information and related feedback 
from the lower levels. Upon completion of this functional task, a command Is Issued to the Immediate lover 
level, and the functional task of the lover level Is accomplished. With this structure, each level evaluates 
and controls the performance of the Immediate lower one. The architectural model associated with top-down 
hierarchical knowledge (Information) processing Is suitable for the decision phase of Intelligent Robots. Tbe 
decision phase Involves formulating complete and compatible plans, deciding which one Is the best to execute the 
requested Job and how to execute It. Therefore. It nay accept special simple architectures specifically 
designed to Implement the Hierarchically Intelligent Control Algorithms. 

Specific hardware units must be built within each of the higher two levels for the upgrade phase of 
Intelligent Robots. This phase Involves the upgrade of the Individual and accrued costs and probabilities 
associated with a particular plan. Upgrade follows plan execution (completion of the decision phase) and is 
performed In a bottom-up way; costs and probabilities associated with the lower level are upgraded first fol- 
lowed by the ones with the higher level. 

The architectural model (of the decision and upgrade phases) Is appropriate for both nodes of operation of 
an Intelligent Robot, the training node and the well-trained mode. The training mode of operation Is defined as 
the mode In which the Intelligent Robot "explores" and "learns" Its capabilities and alternative actions given 
the user(s) requested job(s). While In this mode, the probabilities are significantly modifiable by the learn- 
ing algorithms rewarding certain plans and penalizing others C3]. The well-trained mode of operation follows 
the training node and Is defined as the node In which the Intelligent Robot Is well trained and knows exactly 
the sequence of actions necessary to complete a user requested Job [6]. The well-trained mode mists only when 
there are not situations which might Include unpredictable events. 

This paper describes both models for the higher two levels of Intelllgert Robots. Section three of the 
paper presents the pertinent definitions necessary for the derivation of the models. Sections Four and Five 
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present the models for the decision-phase of the organization and coordination levels, while section Six ex- 
plains the architectural eodel for the upgrade phase of Intelligent Robots. Section Saves presents the 
advantages of the eodels. 


3 . o ef bu ttons 

for every Intelligent Robotic Systee define [4,51: 

1. The set of user commands 0(c 1 .c 2 »...,c H i M fixed and finite} with associated probabilities p(c n ). 
n-l,2,..M, sent to the Intelligent Robot via any renota or not channel. 

2. The set of classified conplled Input canaunds IMu^, u 2 >...»u M ; M fixed and finite) with associated 
probabilities p(Uj/c n >* J*1»2,..M, which are the Inputs to the' organization level of the system. 

3. The task domain of the Intelligent Robot with the set of independent but not Mutually exclusive dis- 
joint sub-sets of non-repetiti ve and repetitive primitive events E * (E nr ,E p ) * 

{e 1 »e 2 »...ej t _ L .ej IJ _ 1+ j»...e H { H fixed and finite). 

4. The binary valued randoa variable x, associated with each e < indicating if e i is active 1x^1) or 
inactive (xj*0) given a u^» with corresponding probabilities p(Xj«l/Uj) and p(Xj*0/Uj) respectively. 

5. The set of the (2^-1) activities which are groups of primitive events concatenated together to define a 
complex task. They are represented by a string of binary random variables x j b “ ,x j» x 2» * • • x n , e ; 

m»l»2»..»(2 M -l)» which Indicates which e^'s are active or inactive within an activity with a probabil- 
ity P(X JB / Uj ). 

6. The set of compatible ordered activities obtained by ordering the primitive events within each activity 
and represented by a string of compatible ordered binary random variables Yj >p . where r denotes the rth 

ordered activity obtained from Xj^. with a probability P(Y j mr /u j^‘ 

7. The set of compatible augmented ordered activities obtained by inserting repetitive primitive events 
within appropriate positions of each Yj B| and represented by V j -r <* s >* * hBrB * s denotes the sth aug- 
mented activity obtained from Yj Bp with a probability P<Yj^ . 

8. The set of mask matrices Nj >p with associated probabilities piNj^/Uj) used to obtain the coaq>at1b1e 
ordered activities (Yj Bp ) from the activities (X^). 

9. The set of augmented mask matrices Hj >p (a s ) nlth associated probabilities p(Mj Bp (a s )/Y jBr ) used to 
obtain the compatible augmented ordered activities from each Yj >p . 

When a user command C n with a probability p(C n ) is sent to the Intelligent Robot it is received and clas- 
sified by a classifier to yield the classified command Uj; with a probability plujj/(n)» which is the input to 
the organization level. 


4. MODEL FOR DC ORGANIZATION LEVEL 

The organization level performs five sequential functions as shown In Figure 2: machine reasoning, plan- 

ning, .decision making, feedback and long-term m o m cry exchange. The last two are performed during the upgrade 
phase! The organizer formulates complete and compatible plans and decides about the best possible plan to 
execute the user requested Job. This is done by associating u^ with a set of pertinent activities Xj b with 

corresponding prooabllitles PiX^/Uj) (reasoning), and by organizing the activities In such a way (planning) to 
yield co«^)lete and compatible plans: The compatible ordered activities Yj >p associated probabilities are: 

P(Y, /u ,■ p(M, /u,)*P(X. /u,). The compatible augmented ordered activities Y. _(a_) are obtained by Inserting 
repetitive primitive events in appropriate positions within each Yj >p and their corresponding probabilities are; 
P(Yj Bp ( a s )/Yj Bp )«p(Mj Br (a s )/Yj I|p )*P(Yj Bp /Uj). EvBr > '"compatible activity and ii^omplete plan is rejected UJ. 

The most probable complete and ccmpatible plan Y F Is the final plan that is transferred to the coordination 
level. 

After the completion of the requested Job upgrade of the probabilities and stored information fellows as it 
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■Ill ba explained In section Six. Figure 3 shoes the analytical probabilities Illustration of the complete 
organization level function. 

The architectural nodal for the nachlne reasoning function ts shorn In Figure 4. The Input to the nodal Is 

R N 

the (classified) cooplled Input coonand Uj and the corresponding output. Zj » the set of the (naxlnea) (2-1) 
pertinent activities ulth the corresponding addresses which store the activity probabilities P(Xj b /uj). The 

reasoning block RB contains the (2 N -1) strings of binary valued randoa variables stored at a particular order, 
which represent the activities associated with any conplled Input conaand. The corresponding addresses which 

D 

store the probabilities related to these activities are transferred froa the memory 0 > a part of the long-tern 

p 

aeaory of the organizer. The aeaory D consists of M different aeaory blocks D^» One eeaory block. 

Dj» ts associated with each conplled Input ccaaand Uj. Cnee the conplled Input conaand Uj has been recognized, 
realization of the switch s^ activates (enables) the aeaory block Dj. Transfer of the data (addresses) con- 
tained In Dj Is accoapllshed via the realization of the switch 5j. The switches are coupled with each other. 

The contents of the RB are transferred to the right aost positions of the PRB (Probabilistic reasoning block) 
while the corresponding addresses which store the pertinent probabilities occupy the left nost positions. The 

R R 

Infornatlon stored In D Is not aodlflable by. or during the nachlne reasoning function. Therefore. D is 

considered as permanent n o ncry whose values do not change during an Interaction cycle . 1.e.» fron the tine the 
user has requested a Job until Its actual execution. The values of the probability distribution functions 
associated with the set of pertinent activities are upgraded only after the conpletlon of the requested Job 
through a specific hardware unit described In section Six. 


The model for the nachlne planning function Is more complicated. It Is shown In Figure 5. The Input to 

R P 

the planning nodel Is Zj . The output from the machine planning model is. Zj . the set of all complete and 

compatible plans capable to the set of all compatible augKnted ordered strings of primitive events Y j Br (a s ) 

formulated during the nachlne planning function. All compatible ordered activities are stored In the first 
planning box. PB1. Every compatible augmented ordered activity Is stored In the second planning box. PB2. The 
two compatibility tests (one to obtain conpatlble ordered activities and one to obtain compatible augmented 
ordered activities) are performed within the boxes CPT1 and CPT2. The specific hardware unit for both com- 
patibility tests Is shown In Figure 5(b). The me mory D^., also a part of the 'long-term memory of the organizer. 

Is divided Into four sub-blocks. D^. and 0 T< : contains all Incompatible pairs of the form (non- 

repetltlve primitive, non- repetitive primitive). 0^ 2 of the form (non-repetltlve primitive, repetitive 
primitive). of the form (repetitive primitive, non-repetltlve primitive) and D T4 of the form (repetitive 

primitive, repetitive primitive). Each ordered activity (augmented ordered activity) Is transferred to the 
register R(R'). At the beginning of the compatibility test the pointer PT (PT’) Is at the left most position of 
R (RM. It transfers every pair of primitives to the two-position register RI (RIM, which scans °T1 (D T1' °T2' 

and D.^, to check If the stored pair is Incompatible. If yes, the whole ordered activity (augmented ordered 


activity) Is rejected. If not. the left most primitive event In Rl (RIM Is discarded, the right most moves one 
position to the left and a new primitive event occupies the empty position. The test continues until the 
pointer has reached the last two primitive events of the activity. Therefore, the number of compatible ac- 
tivities Is significantly reduced. The corresponding addresses of the conpatlble ordered activities with the 

p 

mask probabilities pIMj^/Uj) are transferred from the memory via the realization of the coupled switches s^ 


and s 4 . The switch s^ activates the corresponding memory blcgk D j j (once Zj has been recognized), while the 
switch s 4 permits the transfer of data. The box PB1 now contains the compatible ordered activities with their 


corresponding addresses containing the probabilities P(Yj Br /Uj). The Insertion of the repetitive primitive 

events Is performed In the box INS while the compatible augmented ordered activities are stored In the second 
planning box. PB2. Their corresponding memory addresses with the augmented masks probabilities p(M. (a )/Y > 

p J®* 5 j®r 

are transferred fron Dj . Activation and transfer of data from the appropriate memory block D^j is ac- 
complished via the realization of the two coupled switches Sj and s^ In a way similar to the ones described 


before. 


_ P P 

The information stored In D, and 0, Is not modifiable by, or during the machine planning function. 


This Information Is considered penwanent within an Iteration cycle, too 


The output fron the machine planning 


function Zj is the set of all cosiplete and compatible ordered activities that may execute the requested job. 
The completeness test Is performed within LCKT- This test accepts every meaningful syntactically correct plan 


The model for the machine decision making function is shown in Figure 6. All compete and compatible plans 

O 

Zj are stored In MDMB (nachlne decision making box) and checked by pairs to find the most probable one. The 
nost probable plan Is stored In RR. If during the check, a complete plan with higher probability than the one 
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already stored In RR Is found* ft is transferred to RR while the already stored one is discarded. Once the 
check Is over* the contents of RR Indicate the most probable complete and compatible plan to execute the re- 
quested job. 

Every complete and compatible plan Is also stored In a particular part of the long-term memory of the 
organizer* D $s . This memory contains every complete and compatible plan related to every compiled Input comm and 

as shown in Figure 6. The idea of this particular memory is very important! It represents the situation of a 
well-trained Intelligent Robot (under the assumption that no unpredictable events may occur). An Intelligent 
Robot which has reached this mode of operation associates Immediately after the recognition of the compiled 
input command the most probable of the plans (If more than one available) stored in 0 js * without going through 

every single Individual function. 


5. MODEL FOR TIC COORDINATION LEVEL 

The coordination level is composed of a specific nueber of coordinators as shown in Figure 7. Its purposes 
to coordinate the Individual tasks* select the appropriate performance requirements for the execution level* 
Identify space limitations and assign penalty functions* optimize the performance of the overall plan and use 
learning for performance improvement. It Issues specific commands to the execution level which Is composed of a 
number of execution devices associated with the coordinators at the coordination level. The Interaction between 
the three levels is represented In terms of on-line (real-time) and off-line feedback Information. The on-line 
feedback Information Is communicated from the execution to the coordination level during the execution of the 
requested Job and is used to evaluate and upgrade the Information stored In the long-term memory of the or- 
ganization level (functions of feedback and long-term memory exchange). 

A block diagram of the coordination level architectural model Is shown In Figure 8. The complete and 

compatible plan Y F stored In RR Is transferred to a buffer B. The complete and compatible most probable (final) 
plan* contains actually a sequence of addresses. Each address corresponds to a primitive event (repetitive or 
non-repetltive). When the final plan Is loaded Into the buffer the BEVEUT line Is activated and the pointer PTl 
scans the buffer once from left to right. With the aid of the qualifier OLFR It Is known how many times each 
coordinator will be accessed* as well as when It will be accessed. Thus* the association execution devices are 
activated when their coordinator Is accessed via the qualifier OLFR. After the first scanning, the pointer PTl 
returns to the left most position. The 8EVEMT line Is deactivated and the qualifier Is used to activate another 
coordinator as the pointer moves from left to right. Upon completion of Its operation a BENT signal is sent to 
the qualifier and the buffer and the pointer moves one position to the right. When a specific coordinator 
completes Its specific functions and the on-line feedback Information has (already) been comaunlcated to It. 
this Information Is stored In the short-term memory of the coordination level. It may be used by other coor- 
dinators to complete their functions (during the execution of a requested Job) and/or to calculate the overall 
accrued cost associated with the coordination level* that will be communicated to the organizer after the execu- 
tion of the Job. Thus* the different coordinators do not communicate directly with each other. But each 
coordinator has access to the short-term m emory for storage and retrieval of data. 

The coordination level does not have a particular memory equivalent to the D sj memory of the organization 

level. This Is because the workspace environment of the coordination level Is dynamic: Given a final plan > 

the formulation of the actual control problem regarding the way of Its execution depends not only on previous 
experience but also on the current conf Iguration of the workspace environment. For example* previously chosen 
trajectories for the different motions of the nanlpulator(s) should be modified by the presence of more or less 
obstacles and/or of additional objects. 

The execution level performs the commands Issued by the coordination level. Each control problem Is 
analyzed In the light of Its special requirements. Therefore, there Is not one general architectural model that 
can Include every possible operation performed at the execution level. 

But although this Is the case* the execution level consists of a number of devices each associated with a 
specific coordinator and vice versa. Each device Is accessed via a command Issued by Its coordinator. Hence* 
the hierarchical structure Is preserved. 

6. NOBELS FOR DC UPGRADE PHASE 

The architectural model for the upgrade phase of Intelligent Robots includes specific hardware units t*!a1 
must be built within each of the higher two levels to account for both types of feeooack Information* on-Hm 
and off-line feedback. 

The off-line feedback mechanism (from the coordination to the organization level) Is activated after th* 
execution of the requested Job and Is used to upgrade the probabilities distribution functions of the sets ot 
pertinent, ordered and augmented ordered activities associated with a cot? lied input comand. 

The probabilities upgrade algorithm Is given by the equation: 

p(t-*T/Uj) » p(t/Uj)+= t+1 CC-p(t/Uj)I (1) 

« ■ {o' ‘^Sl. 
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•tor* pCt+l/Uj) denotes tto corresponding probability at Iteration cycle tt+1) » J the actual cost of execution of 
the Job* J B)l the minimum cost of execution and 6 a coefficient that obeys Dvofcetsky's conditions [33. Each 

upgrade requires one additions one subtraction and one Multiplication. During this process there are no data 
dependencies between probabilities. A special purpose hardware unit Is tto one shown In Figure 9. It consists 
of two adderss on* aultlpllcator unit and three registers C7}. The probability value Is fetched f roe the 
■eeorys passes through the three arithmetic operations and Is returned to the memory. overwriting tto previous 
value. This function Is performed after the execution of the requested Job and calculation of the overall 
accrued cost associated with tto coordination level. 

Five such hardware units nust be built In the organization level to upgrade all pertinent pdfs as shown In 
Figure 10. 

The on-line feedback each an Isa (from the execution to the coordination level) Is activated during the 
execution of the requested Job. A block dlagraa of this nee h an Isa Is shown In Figure 11. Solid 1 lees repre s ent 
the on-line feedback Information froa the execution devices (at the execution level) to tto different 
coordinators. Individual and accrued costs are calculated within each coordinator and are transferred to the 
short-tern aaaory of the coordination level where tto overall accrued cost associated with the coordination 
level Is calculated and c o mm u nicated back to the organizer after tto execution of the Job. Tto dotted lines 
Illustrate how the Information froa tto short-term meenry is used by tto different coordinators and their execu- 
tion devices for tto coapletton of tto Job. 


7. REMARKS 

The models presented here have two major advantages: 

1. They are applicable to any Intelligent Machine operating under the constraints of Hierarchically 
Intelligent Control Systems. and* 

2. The saae architecture may be used If one uses a linguistic approach to design Intelligent Machines. 
Based on the models described* one nay derive tto context-free grammars that satisfy tto same perfor— 
aance requi re me n ts and criteria. 

The architectural model of the organization level My be also used If one wishes to modify the machine 
reasoning function In the algorithm of tto organization level as follows: Given a compiled Input command Uj* 

associated with It only a subset of the (2*-l) pertinent activities which contains only those activities with 
corresponding probabilities greater than a prespecified P >ff| (Uj). Therefore* the machine planning and decision 

making- functions are Halted to the formulation of complete and compatible plans that originate from this subset 

of the (2*-!) possible pertinent activities. This approach requires decision making froa the beginning: the 

machine reasoning function because It eliminates every activity with corresponding probability less than 


The disadvantage of the architectural model Is that It does not consider the possibility of unpredictable 
events during plan(s) execution. 
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